Machine learning software accounts for a significant amount of energy consumed in data centers. These algorithms are usually optimized towards predictive performance, i.e. accuracy, and scalability. This is the case of data stream mining algorithms. Although these algorithms are adaptive to the incoming data, they have fixed parameters from the beginning of the execution. We have observed that having fixed parameters lead to unnecessary computations, thus making the algorithm energy inefficient. In this paper we present the nmin adaptation method for Hoeffding trees. This method adapts the value of the nmin parameter, which significantly affects the energy consumption of the algorithm. The method reduces unnecessary computations and memory accesses, thus reducing the energy, while the accuracy is only marginally affected. We experimentally compared VFDT (Very Fast Decision Tree, the first Hoeffding tree algorithm) and CVFDT (Concept-adapting VFDT) with the VFDT-nmin (VFDT with nmin adaptation). The results show that VFDT-nmin consumes up to 27% less energy than the standard VFDT, and up to 92% less energy than CVFDT, trading off a few percent of accuracy in a few datasets.

Hoeffding trees with nmin adaptation / Garcia-Martin, Eva; Lavesson, Niklas; Grahn, Hakan; Casalicchio, Emiliano; Boeva, Veselka. - (2019), pp. 70-79. (Intervento presentato al convegno 5th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2018 tenutosi a Turin; Italy) [10.1109/DSAA.2018.00017].

Hoeffding trees with nmin adaptation

Casalicchio, Emiliano;
2019

Abstract

Machine learning software accounts for a significant amount of energy consumed in data centers. These algorithms are usually optimized towards predictive performance, i.e. accuracy, and scalability. This is the case of data stream mining algorithms. Although these algorithms are adaptive to the incoming data, they have fixed parameters from the beginning of the execution. We have observed that having fixed parameters lead to unnecessary computations, thus making the algorithm energy inefficient. In this paper we present the nmin adaptation method for Hoeffding trees. This method adapts the value of the nmin parameter, which significantly affects the energy consumption of the algorithm. The method reduces unnecessary computations and memory accesses, thus reducing the energy, while the accuracy is only marginally affected. We experimentally compared VFDT (Very Fast Decision Tree, the first Hoeffding tree algorithm) and CVFDT (Concept-adapting VFDT) with the VFDT-nmin (VFDT with nmin adaptation). The results show that VFDT-nmin consumes up to 27% less energy than the standard VFDT, and up to 92% less energy than CVFDT, trading off a few percent of accuracy in a few datasets.
2019
5th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2018
data stream mining; energy aware machine learning; energy efficiency; green artificial intelligence; Hoeffding trees; signal processing; information systems and management; statistics, probability and uncertainty; computer networks and communications
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Hoeffding trees with nmin adaptation / Garcia-Martin, Eva; Lavesson, Niklas; Grahn, Hakan; Casalicchio, Emiliano; Boeva, Veselka. - (2019), pp. 70-79. (Intervento presentato al convegno 5th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2018 tenutosi a Turin; Italy) [10.1109/DSAA.2018.00017].
File allegati a questo prodotto
File Dimensione Formato  
Garcia-Martin_Hoeffding-Trees_2019.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 303.13 kB
Formato Adobe PDF
303.13 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1267111
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 6
social impact